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Abstract. This paper deals with an extension of the concept of correlated strategies to Markov stopping 
games. The Nash equilibrium approach to solving nonzero-sum stopping games may give multiple solutions. An 
arbitrator can suggest to each player the decision to be applied at each stage based on a joint distribution over 
the players' decisions. This is a form of equilibrium selection. Examples of correlated equilibria in nonzero-sum 
games related to the staff selection competition in the case of two departments are given. Utilitarian, egalitarian, 
republican and libertarian concepts of correlated equilibria selection are used. 

1. Introduction In this paper an alternative approach to the staff selection competition in the case 
of two departments considered by Baston and Garnaev Q is proposed. The formulation of the problem 
in Baston and Garnaev [Q is as follows. Two departments in an organisation are each seeking to make 
an appointment within the same area of expertise. The heads of the two departments together interview 
the applicants in turn and make their decisions on one applicant before interviewing any others. If a 
candidate is rejected by both departmental heads, the candidate cannot be considered for either post at 
a later date. When both heads decide to make an offer, they consider the following possibilities. 

1. The departments are equally attractive, so that an applicant has no preference between them; 

2. One department can offer better prospects to applicants, who will always choose that department. 

The departmental heads know that there are precisely TV applicants and that each applicant has a level 
of expertise which is random. It is assumed that the interview process enables the directors to observe 
these levels of expertise, which form a sequence of i.i.d random variables from a continuous distribution. 
If no appointment is made to a department from these applicants, then the department will suffer 



2000 Mathematics Subject Classification: Primary 60C40; Secondary 90A46. 

Key words and phrases: correlated equilibria, Nash equilibria, non-zero sum game, secretary problem. 
The paper is in final form and no version of it will be published elsewhere. 

The idea of this paper was presented at Game Theory and Mathematical Economics, International Conference 
in Memory of Jerzy Los (1920 - 1998), Warsaw, September 2004 ^ 



[1] 



2 



D. RAMSEY AND K. SZAJOWSKI 



from a shortfall of expertise. Game ^ has one Nash equilibrium, which can be used as the solution 
to the problem. Game m has many Nash equilibria. This raises the question of equilibrium selection. 
Baston and Garnaev Q interpreted such a variety of Nash equilibria solutions as a way of modelling 
different dynamics within the organisation, which can result in various outcomes during the conscription 
process. If one departmental head is aggressive and one passive, we might expect a different outcome 
to the one in which both are of a similar temperament. When both have a similar temperament one 
expects a symmetric strategy and value, but when they have different temperaments one should expect 
an asymmetric equilibrium and value. The different character of heads is modelled by the notion of a 
Stackleberg leader. Also, the difference in the level of complication of equilibria might also be an argument 
justifying this approach to equilibrium selection. It is shown that these non-symmetric equilibria have 
the advantage that the players use pure strategies, whereas at the symmetric equilibrium, the players are 
called upon to employ specific actions with complicated probabilities. 

The staff selection problem presented above is closely related to the best choice problem (BCP). 
There are some potential real applications of decision theory which strengthen the motivation of the 
BCP (the one decision maker problem). One group of such problems are models of many important 
business decisions, such as choosing a venture partner, adopting technological innovation, or hiring an 
employee using a sequential decision framework (see Stein, Seale and Rapoport fTl[| , Chun |[], Q [], [|)- 
Others are an experimental investigations of the ,, secretary problem", which compare the optimal policy 
from the mathematical model with behaviour of human beings (see Seal and Rapoport [^, |32]). We have 
not found any such investigation for BCP games. It could be that the theoretical results are not complete 
enough to start applied and experimental research. 

In spite of the long history of BCP and its generalisations presented in review papers by Freeman 
jl^ , Ferguson jl^. Rose |27j, Samuels fii^, there are also competitive versions, on which researchers' 
attention has been focused (see Sakaguchi pN, Mj for review papers). Let us briefly recall the main game 
theoretic models of BCP. Enns and Ferenstein Enns, Ferenstein and Sheahan |lT| solved a non-zero 
sum game related to BCP. Some important mathematical results related to the problem, posed in this 
paper, were proven many years later by Bruss and Louchard Q. The full information version of the game 
was solved by Chen, Rosenberg and Shepp Q. The relation between players is as follows. The players 
have numbers: 1 and 2. When an item appears then Player 1 always has the first opportunity to decide 
whether to hire the applicant or not (unless she has hired one already). One can say that Player 1 has 
priority. If Player 1 does not hire the current applicant, then Player 2 can decide whether to hire the 
applicant or not (unless she has hired one already). If neither player hires the current applicant, they 
interview the next applicant. The interview process continues until both players have hired an applicant. 
A hired applicant docs not hesitate and accepts an offer without any delay or additional conditions. The 
games in this group of papers have the same strategic scheme as in Game 

The concept of equal priority of the players in the selection process in a model of a non-zero-sum game 
related to BCP was introduced by Fushimi jl^. Szajowski extended this model to permit random 
priority. Ramsey and Szajowski |^, considered a mathematical model of competitive selection with 
random priority and random acceptance of the offer (uncertain employment) by candidates. Uncertain 
employment is a source of additional problems, which are solved as follows. At each moment n the 
candidate is presented to both players. If neither player has yet obtained an object then: 

(i) if only one of them would like to accept the state, then he tries to take it. In this case the random 
mechanism assigns the availability of the state (which can depend on the player and the moment of 
decision n); 

(ii) if both of them are interested in this state, then the random device chooses the player who will first 
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solicit tlie state. The availability of the state is the same as in the situation when only one player wants 
to take it. If the chosen player obtains the state, he stops searching; 

(iii) If this state is not available to the player chosen by the random device, then the observed state at 
moment n is lost to both players. Both players continue searching by inspecting the next state. 

When one player has obtained a candidate the other player continues searching alone. If this player 
wishes to accept a candidate, the probability that it is available to him is the same as in point (i) above. 

When a non-zero-sum game does not have a unique Nash equilibrium, then communication between 
the players would be useful in deciding which equilibrium should be played. Using the idea of correlated 
strategies introduced by the set of possible strategies is extended to the set of correlated stopping 
times and the actions undertaken by the players are correlated. 

Little research has been carried out on the role of communication between players in stopping games, 
and consider correlated equilibria in general dynamic games. The form of correlation is not 
unique. The approach applied here is based on a generalisation of randomised stopping times. Various 
additional criteria used by the players to correlate their actions restrict the set of possible solutions. These 



criteria are based on those used in 1 18 , which resemble ideas of solutions of cooperative games presented 
in 0. 

Strategies of staff selection based on the construction of correlated strategies according to various 
selection criteria are presented in the setting adopted by Baston and Garnaev ||]. Correlated strategy 
selection was proposed by the authors in . 

The construction of correlated equilibria in stopping games is based on the concept of correlated 
equilibria in two- by- two bimatrix games. The geometry of correlated equilibria in bimatrix games is 
described by Calvo-Armengol Q]. 

2. Correlated equilibria in stopping games introduced a correlation scheme in randomised 
strategies for non-zero-sum games extending the concept of Nash equilibrium. Using this approach some 
process of preplay communication is needed to realise such a strategy. Aumann's approach has been 
extended in various manners (eg see |l^, |l^, |l^, ^ @)- The process of adapting correlated equilibria to 
stopping games starts from the idea of correlated stopping times. 

Definition 1. A random sequence q = {(fin, qn^ In)} such that, for each n, 

(i) qn is adapted to Tn for i — 1,2,3; 

(ii) < ql < ql < q^ < 1 a.s. 

is called a correlated stopping strategy. The set of all such sequences will be denoted by . 

Let Ai, A2, . ■ . T Ai^ be a sequence of i.i.d. r.v. with uniform distribution on [0,1] and independent 
of the Markov process {XmTm'Px)n=o- Denote g„ = {ql^,q^,q^). Correlated stopping times are pairs 
{\^{q), A^((7)) of Markov stopping times with respect to the cr-ficlds Hn — <j{Tm {^1,^2, ^n}} defined 
by the strategy q = [qn) E as follows: 

(1) X'{q)=ini{0<n<N ■.An<ql} 
and 

(2) A2(g) = inf{0 <n<N ■.An<q'nOTql<An< qf,}. 

The strategy q will be called the correlation profile and it defines the pair of stopping times (A^ (q), A^(g)). 

In intuitive terms, the vector (f„ = ((7^,(7^,(7^^) defines the joint distribution of the actions taken by 
the players at moment n: with probability both players choose the action "stop", with probability 
Qn ~ Qn Player 1 stops and Player 2 chooses the action " continue" , with probability — Player 1 
continues and Player 2 stops and with probability 1 — q^ both players continue. A correlated strategy q 
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is assumed to be defined by preplay communication between the players (either before the start of the 
game or before each decision) with the possible aid of an "external judge" . If commimication only takes 
place before the game commences, then such a correlation is said to be a stationary correlation device. 
If communication may occur at each decision point, then such a correlation is said to be an extensive 
(autonomous) correlation device (see ||3^). In general, we consider extensive correlation devices. The form 
of the correlated strategy is known to both players. 

If one player carries out the actions suggested by the external judge with the aid of the appropriate 
lottery and the other player departs from the suggested action a formal construction of the possible 
strategies and the calculation of the expected gains should be done. 

Let p = {pi,P2, ■ ■ ■ tPn) be a sequence in the unit interval. If Player i departs from the correlation 
profile q, then the strategy of the other player is based on the marginal correlated profile q-i and the 
strategy of Player i is defined by pi = p. Denote T'^{{pi,q^i)) = r'^ipi) = inf{0 < n < N : yl„ < p„}, 
where (A^)^^^ is a sequence of i.i.d. r.v. with uniform distribution on [0,1], independent of (An)^^^ 
and independent of the Markov process (X„, J^n, Px)n=o- Denote Gi{q) — Gi{X^{q) A A^(g), X;^i(g)AA2(<j)) 
and Gi{{pi,q-i)) — Gi(T^{pi) AX~'''{q-i), X.,-i(p-)A\-Hq-i))- The expected payoffs arc defined as Gi{x,q) = 
E^G'i(g) and G,{x, {pi,q-,)) = Er,Gi{{pi,q^i)), respectively. 

Definition 2. A correlated stopping strategy q* G is called a correlated equilibrium point ofQm, 

if 

(3) G,(x,r) >4(x,(p„g*,)) 

for every a; G E, p and i = 1,2. 

This is a definition of a correlated equilibrium in the normal form of the game. It should be noted 
that a stronger notion of correlated equilibrium can be introduced by requiring that the correlation must 
define an equilibrium in each restricted game where n steps remain (l<n<A^ — 1). 

3. Selection of a Correlated Equilibrium Since the set of Nash equilibria is a subset of the set 
of correlated equilibria, it is clear that whenever the problem of the selection of a Nash equilibria exists, 
the problem of the selection of a correlated equilibrium also exists. However, the notion of correlated 
equilibrium assumes that communication takes place. Such communication can be used to define the 
criteria used by players to select a correlated equilibrium. We now formulate various criteria for selecting 
a correlated equilibria. These criteria select subsets of CE. The concepts which are used here do not come 
from the concepts of solution to Nash's problem of cooperative bargaining. These concepts were used by 
Greenwald and Hall jl^ for computer learning of equilibria in Markov games. 

Definition 3. Let us formulate four different selection criteria for correlated equilibria in a stopping 
game. 

1. A utilitarian correlated equilibrium is an equilibrium constructed recursively in such a way that at 
each stage n~N — 1,N — 2,...,1 the sum of the values of the game to the players is maximised given 
the equilibrium calculated for stages n + l.n + 2, . . . , N is played.. 

2. An egalitarian correlated equilibrium is an equilibrium constructed recursively in such a way that at 
each stage n = N— 1,N — 2,...,1 the minimum value is maximised given the equilibrium calculated for 
stages n + l,n + 2, . . . , N is played. 

3. A republican correlated equilibrium is an equilibrium constructed recursively in such a way that at 
each stage n = N — l,iV — 2,...,1 the maximum value is maximised given the equilibrium calculated for 
stages n + 1, n + 2, . . . , is played. 
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Table 1. The five vertices of the correlated equilibrium polytope. 



^. A libertarian i correlated equilibrium is an equilibrium constructed recursively in such a way that at 
each stage n^N — 1,N — 2,...,1 the value of the game to Player i is maximised given the equilibrium 
calculated for stages n + l,n + 2, . . . , N is played. 

Theorem 1. The set of correlated equilibrium points satisfying any one of the given criteria above is 
not empty. 

4. One and two applicant games with no candidate preferences Let us assume that the cost 
of not selecting an appUcant is c. This is the cost of a shortfall of expertise in a department. If a director 
selects an applicant with expertise = x, the department gains x. Let us assume that the candidates 
have i.i.d. expertise with uniform distribution on [0, 1]. If there is only one candidate, then the selection 
process will end with value d = |E^i — = to both players (both want to select and the probability 
of winning is i for both of them). Let b ~ max{0, ^-^}. 

4.1. Correlated equilibria of the two stage game When there are two candidates, then we have a two 
stage game. The subgame perfect Nash equilibria at the stage when the first candidate is interviewed will 
be considered. The payoff bimatrix M2{x) is of the form (see 0): 

s f 

(4) M,{x)^ s /(^i),I^)(^,i)\ 

/ 1^ (i,x) (d,d) J 

The game has one pure Nash equlilibrium, (s, s), for x > and for x < b has one pure Nash equilibrium 
(/, /). However, for x G [6, ^] there are two asymmetric pure Nash equilibria and one symmetric Nash 
equilibrium in mixed strategies. Without extra assumptions it is not clear which equilibrium should be 
played. Baston and Garnaev Q have proposed that if the players have a similar character, then the 
symmetric solution should be played. In the non-symmetric case the idea of Stackleberg equilibrium 
can be adopted. It is assumed that the first player will be the Stackleberg leader and the 1-Stackleberg 
equilibrium is the solution of the problem selected. 

We will use an extensive communication device to construct correlated equilibria. In general, correlated 
equilibria are not unique. Usually the set of correlated equilibria contain the convex hull of Nash equilibria. 
However, natural selection criteria can be proposed and the possibility of preplay communication and 
use of an arbitrator solve the problem of solution selection. The players just specify the criterion. Such 
criteria are formulated in Section |^. The set of solutions which fulfil one of the points in definition ^ 
are not empty. 

For M2(a;), when X G [b, i] the set of correlated equilibria is a polytope with five vertices. Let a = ^^zf- 
and 7 = 2^5f- and let us denote fj. = {iJ,ss, IJ'ff, f^fs, fJ-sf)- The polytope of correlated equilibria for the 
considered game has the five vertices given in Table |l] (see Peeters and Potters The value at each 
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vertex will be calculated. 

(C) The values of the game to the players at vertex C are denoted by vl and ■ 



(c) 

When Player 1 takes the role of Stackleberg leader his expected gain is v{ , while the Stackleberg follower 
has (see |^). 

(D) The values at vertex D can be obtained from those at vertex C, because matrix M2{x) is symmetric. 
(T) + ^ 

(E) The expected gain of the players at correlated equilibrium E given the expertise of the candidate 
X G [b, i] is of the form. 

/„N (E) , In ^"■^ 1/ l^d — x 

= 2(^+2) 

(10) 4""^ = 1(^ + 1)- 

The value of the two-stage game to the players at vertex E is 

(11) = ) =[^'^^\ + = \^'-\^^\- 

The values at these three vertices are such that wj'^-' < vf^^ < wj'^-' . 

(F) This correlated equilibrium is of the form: = and 

y-ff = 73 — q ^ 1 
4a — 3a; — T 
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The expected gain of the players at correlated equilibrium F given the expertise of candidate x G [5, i] is 

{F) _ [F) _ d{x - \) + 2{d - x){x + \) 
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for X e [6, The value of the two-stage game to the players at vertex F is 

{x -\){d- ^-\) 
4d-3a; 



(13) = = ^i"^ + / ' J": % 
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(G) This correlated equilibrium (the Nash equilibrium in mixed strategies) is of the form: 
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The expected gain of the players at correlated equilibrium G given the expertise of the candidate x G [b, ^] 



IS 



(G) (G) 2(d - a;)^(x - 1) + 2(d - x)(.t + 1)(x - ^) + djx ~ |) ^ 
= (2d-x-l)^ 

_i 1, , (:^--|)^M-i(^ + i)] 

"2^^^2^+ {2d-x~^r 
for x G [b, i]. The value of the two-stage game to the players at vertex G is 

_ „,(G) _„,(£) , n ix-l)^id-^{x+^)] 

{2d-x-\) 



(15) = = .1"' + / ' %: 



{E) 

4.2. Selection of equilibria in the two stage game Let us apply the selection criteria on the set of 
correlated equilibria of the two stage game. We thus define a linear programming problem, in which 
the objective function is defined by the criterion and the feasible set is the set of vectors /i defining a 
correlated equilibrium. Hence to find a solution, we compare the appropriate values at each vertex of the 
correlated equilibria polytope described in the previous section. 

It should be noted that when cither the republican or egalitarian criterion is used, the solution is 
given by the appropriate solution from one of two linear programming problems. In these cases the two 
linear programming problems are: 

1) Maximise vi given the equilibrium constraints and the constraint vi < V2 when the egalitarian condi- 
tion is used or vi > V2 when the republican condition is used. 

2) Maximise V2 given the equilibrium constraints and the constraint V2 < vi when the egalitarian condi- 
tion is used or V2 > t'l when the republican condition is used. 

From the symmetry of the game the hyperplane /i/s ^ Ms/ = splits the set of correlated equilibria 
into the two feasible sets for these problems and /x = (0,0, i, i) becomes a vertex of the feasible set in 
each of the problems. We call this vertex H. This vertex replaces vertex C or vertex D depending on the 
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additional constraint. Wc have 



(C) , (D) 
(H) _ JH) _ Vj '+Vi _ JE) 



(16) v\">^v, 2 

4.2.1. Libertarian equilibria From (p|)-(p^ it follows that the maximal game value for the first player 
is guaranteed at vertex (/, s) and for the second player at (s, /). It means that Sj^i = (/, s) = C is the 
libertarian 1 and ^ (*i f)~Dis the libertarian 2 correlated equilibrium. In relation to the solutions 
presented by Baston and Garnaev, the libertarian i equilibrium corresponds to the Stackleberg solution 
at which Player i takes the role of the Stackleberg leader. 

4.2.2. Egalitarian equilibria Let us denote ~ niinie{i,2} ■ We are looking for 6^^ such that i;*^^ = 
maxsv^. For d g {E,F,G,H} we have = w^, vf^ < uj^' = v["^ and up' < v[^\ For S £ {C,D} 
the minimal values are v'^^'^ = V2^^ and v^^^ = v[^\ Moreover, t^j*^' = v[^^ < v[^\ Therefore E and 

/i* ( E) 

H define egalitarian equilibria and v = -It follows that any linear combination of these equilibria 
pE + (1 — p)H, where p € [0, 1] defines an egalitarian equilibrium. It should be noted that H is an 
intuitively pleasing solution, since it corresponds to a solution in which the players observe the toss of a 
coin and if heads appears Player 1 acts as the Stackleberg leader, otherwise Player 2 plays this role. This 
is one of the solutions considered by Baston and Garnaev. At any of the other solutions the arbitrator 
must send signals to each of the players separately in order to obtain the appropriate correlation. It should 
be noted that the value of the game to the players is independent of the egalitarian solution adopted. 

4.2.3. Republican equilibria Let us denote = maxjgj]^ 2} "^-'f ■ Similar consideration of the vertices as 
made in the case of egalitarian equilibria leads to conclusion that the republican equilibria are (5^ g {C, D} 
and = uj*^-* = V2^\ These arc the only two solutions, since they are the unique solutions of the 
two appropriate linear programming programmes described above and correspond to the Stackleberg 
solutions. 

4.2.4. Utilitarian equilibria Let us denote = vf + V2- We have v'^^ = = ^ I + ^ = '2v[^\ 
Since 2b < x + ^, it follows that > v^"^ and v^"^ > v^"^ . Hence, C, D and E are utilitarian 
equilibria. It follows that any linear combination pC + qD + rE {p,q,r > 0,p + q + r = 1) defines a 
utilitarian equilibrium, = = v^_^^ = It should be noted that i7 is a linear comibination of 
these three vertices with p = q = ^,r ~ Q. Also, the value of the game to the players is dependent on the 
utilitarian equilibrium played. 

5. Selection of equilibria in the multi-stage game We define correlated equilibria by recursion 
as a series of correlated equilibria in the appropriately defined matrix games. The correlated strategy 
used when both players are deciding whether to accept or reject the n-th last candidate is given by 

,s/). The game played on observing the n-th last candidate is given by 

s f 



2 ' 2 

where Un is the optimal expected reward of a lone searcher with n candidates remaining (see [2]) and 
are the values of the n-stage game to Players 1 and 2, respectively, when the equilibrium tt is 
played. From the form of the payoff matrix it can be seen that (s, s) is the unique Nash equilibrium when 
X > Un-i- Similarly, (/, /) is the unique Nash equilibrium when x < min{u^_j, w^_j}. 

5.1. Libertarian equilibria First we consider N = 3. From the calculations made for TV = 2, it follows 
that > W2^ . Considering the payoff matrix (/, s) is the unique Nash equilibrium for < a; < u'2^ 
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and both (/, s) and (s, /) are pure Nash equihbrium for ^ < x < U2- There is also an equiHbrium in 
mixed strategies on this interval. Thus, we only need to consider equilibrium selection for tig ^ < a; < U2- 
Since the payoff matrix is now longer symmetric, the vertices of the polytopc defining the set of correlated 
equilibrium are of a different form. However, since (/, s) is a Nash equilibrium, /ia = (0, 0, 1, 0) is a vertex 
of this polytope. For ^ < x < U2, it can be seen that U2 is the maximal payoff in the payoff matrix. It 
follows that ^3 is the vertex that strictly maximises the expected payoff of Player 1 and thus uniquely 
defines the libertarian f equilibrium. It follows that v^^ > w^^ and hence M4{x) is of a similar form to 
M^lx). By iteration it follows that Player 1 plays the role of the Stackleberg leader at the libertarian 1 
solution. Analogously, Player 2 plays the role of the Stackleberg leader at the libertarian 2 solution. For 
the value functions see [2]. 

5.2. Egalitarian equilibrium It will be shown by induction that for iV > 3 an egalitarian equilibrium 
is of the same form as for = 2. Suppose that v^_^ ~ ^n-i- The coordinates of the vertices of the 
polytope describing the set of correlated equilibria is of the form given in Table | with 

and 7 = ^^7—^37^- Considering the values of the game at these vertices when x S [«„_!, m„_i], the 
egalitarian criterion is satisfied at vertices E and H. It follows that = w!^ and any linear combination 
of E and H defines an egalitarian equilibrium. Since w|' = u|' it follows by induction that an egalitarian 
equilibrium is of the required form. In particular, the equilibrium obtained by deciding who plays the 
role of Stackleberg leader based on the result of a coin toss defines an egalitarian equilibrium. 

5.3. Republican equilibria Suppose libertarian 1 is taken to be the republican equilibrium for the last 

2 stages. For N = 3 the calculations are similar to the calculations made for the libertarian 1 equilibrium. 
It can be shown that the libertarian 1 equilibrium again maximises the maximum value. Using an iterative 
argument, it can be shown that the libertarian 1 equilibrium is a republican equilibrium. By the symmetry 
of the game it follows that the libertarian 2 equilibrium is also a republican equilibrium. 

5.4. Utilitarian equilibria Unfortunately, the value function of a utilitarian equilibrium for N = 2 
is not uniquely defined. In order to find a "globally optimal" utilitarian equilibrium, we cannot use 
simple recursion. From the form of the payoff matrix it can be seen that when max{v„_i, < 
X < Un-i the maximum sum of payoffs is a; + Un^i- This is obtained when at least one of the players 
accepts the candidate. Such a payoff is attainable at a correlated equilibrium, since (/, s) and (s, /) are 
correlated equilibrium. It follows from the definition of a utilitarian equilibrium that fJ.n.ff = when 
max{u„_i,'u;„_i} < x < u„_i. 

Theorem 2. The libertarian equilibria are the only globally optimal utilitarian equilibria for N > 

3 (ignoring strategies whose actions differ from those defined by one of these strategies on a set with 
probability measure zero). 

Proof First we show that among the set of utilitarian equilibria the minimum value is minimised 
at the libertarian equilibria for TV > 2. Considering the values of the game at the vertices of the set of 
utilitarian correlated equilibria when N ^ 2 (obtained by adding the additional condition that fJ.2.ff = 
for b < X < the minimum value is minimised at the two libertarian equilibria. From the form of the 
two linear programming problems that define this minimisation problem, it follows that these solutions 
are the only such solutions. 
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By symmetry = . Set fc^ = min{u^, w^}. Assume that < fc^ for all tt ^ LI, L2. We have 

Ll 1 

= / w^^(ia;+ / xdx + - / {x + Un)dx 



Ll 



2 



Ki+i > / / 5r^(a;)dx + - / {x + Un)dx, 

Jo Jkl ^ Ju„ 

where g^^x) is the expected reward of such a player given that x £ From the condition that 

A*",// = it follows that g^ix) > x,\/x € [fcj,u„] and 

fc^+i - > [klf - )^ - xdx = ~ > 0. 



Since among utilitarian equilibria the minimum value is minimised at the libertarian equilibria when 
= 2, it follows by induction that among utilitarian equilibria the minimum value is minimised at the 

libertarian equilibria for n > 2. By symmetry v^^ + = + w^^. 

We now show that the libertarian strategies are the only globally optimal utilitarian strategics for 

TV > 3. From the analysis of the two stage game + = ^ I + ^ utilitarian equilibrium. 

Suppose v^^ + > i;^ + w^. From the conditions for a utilitarian equilibrium tt, it follows that 



{K+wl)dx+ {x + Un)dx 
" 1 + u'" 1 - «+i + = / [i'" + u'" - « + wl)]dx + [x + un- « + wl)]dx 

Jo Jwf;^ 
> [ [X + Un- {vZ+wl)]dx 

[x + u„- (v^i + w^^^) + v^^ + - « + 0]dx > 0. 



This inequality follows from the induction assumption u,^^ ^ ~ +''^ti) > 0, together with v^^ < Un- 
it can be shown that v^^ + ^ — (wj + W3 ) > using a similar argument for n ^ 2 (the first inequality 
in the argument becomes an equality). It follows by induction that for N > 3 the libertarian equilibria 
are the only utilitarian equilibria which are globally optimal in the sense of the utilitarian criterion. 

6. Final remarks In his recent paper, Garnaev has extended the game model introduced in 
Bastou and Garnaev Q to consider the situation where three skills of the candidate are taken into 
account. The proposed solutions to Garnacv's problem arc Nash equilibria and Stackclbcrg strategies, as 
in and these solutions arc derived in his paper. One can also construct correlated equilibria for this 
model, which will be the subject of further investigation. 
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